Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with both emotional and contextual factors. Existing benchmarks typically evaluate linguistic, acoustic, reasoning, or dialogue abilities in isolation, overlooking the integration of these skills that is crucial for human-like, emotionally intelligent conversation. We present EchoMind, the first interrelated, multi-level benchmark that simulates the cognitive process of empathetic dialogue through sequential, context-linked tasks: spoken-content understanding, vocal-cue perception, integrated reasoning, and response generation. All tasks share identical and semantically neutral scripts that are free of explicit emotional or contextual cues, and controlled variations in vocal style are used to test the effect of delivery independent of the transcript. EchoMind is grounded in an empathy-oriented framework spanning 3 coarse and 12 fine-grained dimensions, encompassing 39 vocal attributes, and evaluated using both objective and subjective metrics. Testing 12 advanced SLMs reveals that even state-of-the-art models struggle with high-expressive vocal cues, limiting empathetic response quality. Analyses of prompt strength, speech source, and ideal vocal cue recognition reveal persistent weaknesses in instruction-following, resilience to natural speech variability, and effective use of vocal cues for empathy. These results underscore the need for SLMs that integrate linguistic content with diverse vocal cues to achieve truly empathetic conversational ability.

Artificial intelligence could soon replace the need for office managers - in call centers, at least. According to a recent report from the New York Times, new software by AI firm Cogito can micro-manage workers by monitoring when they talk too fast, lack enthusiasm, or even when their voices aren't conveying enough empathy. Workers are then notified of their performance in real-time via symbolized prompts like a coffee cup or cartoon heart depending on which metrics the program deems are lacking. And the tech is gaining traction: the Times reports that MetLife now uses Cogito - which claims its has 20,000 users, including the health insurance company, Humana - for 1,500 of its call center workers and claims the AI has helped boost customer satisfaction by 13 percent. Call center employees for the insurance giant MetLife are managed by an artificially intelligent boss that can offer tips based on their vocal cues.